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RESEARCH  OBJECTIVES 


The  research  reported  herein  is  concerned  with  improved  information  extraction 
from  single  evoked  brain  potential  waveforms.  Currently  research  is  being  carried  out 
in  the  following  areas. 

a.  Study  of  methods  for  increasing  accuracy  of  classifying  evoked  potential  (EPJ 
waveforms  through  optimized  feature  selection  and  appropriate  preprocessing 
of  the  data. 

b.  Investigation  of  single  EP  processing  and  filtering  techniques  to  provide 
improved  waveform  estimation. 

c.  Investigation  of  the  detailed  structure  of  EP  waveform  components  related  to 
cognitive  processing  of  sensing  input  data. 

SUMMARY  OF  RESEARCH  RESULTS 

Improved  Classification  of  Evoked  Potential  Waveforms 

Exhaustive  Search  Feature  Selection.  As  discussed  in  the  last  report,  a  series  of 
tests  were  run  to  determine  how  much  improvement  is  possible  in  automated 
classification  when  an  optimum  feature  set  is  employed.  These  results  were  extended 
by  carrying  out  an  evaluation  procedure  using  the  “leaving-one-out”  method  which  pro¬ 
vides  a  lower  bound  on  performance  of  the  classifier.  The  paradigm  employed  was 
described  in  the  previous  report  and  consisted  of  presentation  of  a  sequence  of  letter  V’s 
with  random  interstimulus  intervals  and  the  random  insertion  (0.1  probability)  of  an 
inverted  letter  (IV).  The  EP  waveform  was  recorded  at  electrodes  Oz,  Pz  and  Cz. 
Time  samples  20  ms  apart  were  used  as  the  feature  set  and  upper  and  lower  bounds  on 
accuracy  of  classification  were  determined.  The  upper  bound  (UB)  was  taken  to  be  the 
performance  when  training  and  testing  were  done  on  the  same  data  set  and  the  lower 
bound  (LB)  was  taken  to  be  the  performance  when  the  leaving-one-out  method  was 
used.  Table  1  gives  the  performance  of  four  classifiers  employing  five  time  samples 


selected  in  accordance  with  methods  appropriate  to  that  procedure.  The  classification 
procedures  used  were:  linear  discriminant  function  with  forward  sequential  feature 
selection  (FSFS  (linear));  quadratic  discriminant  function  with  forward  sequential 
feature  selection  (FSFS  (quadratic));  step-wise  linear  discriminant  analysis  (SLDA); 
linear  discriminant  function  with  exhaustive  search  feature  selection  (ESFS). 

Exhaustive  feature  selection  algorithms  typically  require  many  hours  of  computer 
time  to  select  five  features.  The  best  implementation  of  ESFS  employed  in  this  study 
required  34  minutes.  This  is  on  the  order  of  100  to  1000  times  faster  than  typical 
implementations.  The  final  version  is  about  10  times  slower  than  the  subop timal 
feature  selection  algorithms  which  normally  require  2  to  5  minutes  of  computer  time.  It 
must  be  emphasized  that  to  realize  the  speed  of  this  or  any  exhaustive  algorithm,  the 
number  of  features  in  the  data  records  should  be  as  small  as  possible. 

The  classification  accuracies  listed  in  Table  1  show  that  in  general  the  ESFS  algo¬ 
rithm  results  in  a  2-3%  improvement  in  classification  accuracy  over  the  linear  subop- 
timal  algorithms.  The  classification  accuracies  in  all  cases  were  high  suggesting  that 
ERPs  from  a  VTV  paradigm  are  indeed  easily  linearly  separable.  Note  that  since  both 
the  upper  and  lower  bounds  were  considered  in  determining  the  best  feature  set,  there 
are  three  examples  where  a  suboptimal  algorithm  (FSFS  linear)  did  better  on  one  of  the 
error  bounds.  In  subjects  2  and  4  for  electrode  Oz  the  upper  bound  was  better  and  in 
subject  5  for  electrode  Pz  the  lower  bound  was  better.  The  case  where  both  bounds 
were  better  for  the  linear  suboptimal  algorithms  never  occurred.  The  best  improve¬ 
ments  were  3-8%  using  data  from  electrode  Pz.  This  is  expected  since  the  P300  is  a 
maximum  in  the  parietal  region  of  the  brain.  The  best  accuracy  bounds  were  also 
found  for  data  from  electrode  Pz.  The  ESFS  classification  accuracy  (excluding  subject 
5)  was  bounded  between  85%  and  93%.  These  results  are  comparable  to  the  quadratic 
FSFS  and  in  one  case  are  better.  air  force  office  of  scientific  resea k  -m  ~ 
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The  quadratic  FSFS  algorithm  performed  very  well.  There  were  significant 
improvements  in  the  lower  bounds  even  over  ESFS  in  most  cases.  This  fact  raised  the 
question  of  how  well  a  quadratic  ESFS  algorithm  would  perform.  Because  the  exhaus¬ 
tive  quadratic  algorithm  cannot  be  implemented  efficiently,  however,  it  was  not  investi¬ 
gated.  The  performance  of  the  quadratic  FSFS  algorithm  suggests  that  it  would  be 
preferable  to  any  linear  exhaustive  algorithm  for  both  classification  accuracy  and  speed. 

Preprocessing  for  Improved  Classification  Accuracy.  Research  is  being  carried  out 
to  investigate  the  use  of  temporal  and  spectral  characteristics  of  evoked  potentials  to 
improve  classification  and  detection  accuracy  and  identify  the  underlying  components 
and  their  parameters.  Estimation  of  the  frequency  components  over  short  time  inter¬ 
vals  helps  identify  time  varying  components  in  the  signal.  If  a  particular  frequency 
component  or  band  of  frequencies  is  found  to  be  prevalent  or  reliably  detected  in  the 
same  short  time  segments  of  signals  from  an  ensemble  of  data,  that  portion  may  be 
represented  by  a  component  in  a  space  of  finite  duration  sinusoidal  basis  functions. 
Since  the  data  segment  is  finite,  the  mapping  will  be  onto  a  portion  of  a  sinusoid  whose 
phase  must  also  be  determined. 

The  basic  EEG  components  are  modeled  as  a  sum  of  windowed  sinusoids.  If 
several  segments  of  the  signal  are  found  which  reliably  map  to  various  sinusoidal  fre¬ 
quencies  with  a  similar  phase  from  the  analysis  of  an  ensemble  of  EP  data,  then  that 
portion  of  the  signal  may  be  considered  to  be  a  summation  of  the  various  sinusoidal 

segments  located  at  different  latencies: 

N 

s(t)  =  Yj  sin(27rfjt  +  0;)w(t  -  t,) 
i=t 

where  the  signal  s(t)  is  a  summation  of  individual  components  which  are  segments  of 
the  sine  waves  at  frequencies  fj  with  phase  <f>it  windowed  about  time  t;  with  an 
appropriate  windowing  function.  This  windowing  function  will  depend  on  the  actual 
spectrum  about  the  frequency  fj.  It  will  alter  the  sinusoid  by  diminishing  its  amplitude 
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at  the  ends  of  the  segment  from  which  it  is  mapped.  Outside  the  segment  it  would  be 
considered  to  be  zero  or  diminish  to  zero  within  a  short  interval.  Many  forms  of  com¬ 
ponents  may  be  considered  by  using  different  sinusoidal  components  and  windowing 
functions  which  may  be  estimated  from  the  average  spectrum  of  the  data. 

The  present  research  tests  the  efficacy  of  using  selected  amplitudes  from  the  time- 
frequency  plane,  or  equivalently,  portions  of  the  real  part  of  the  time-varying  spectrum, 
as  features  in  classifiers  to  distinguish  brain  evoked  potentials.  Previous  work  has 
focused  on  features  taken  from  one  dimensional  systems,  mainly  amplitudes  from  the 
time  dimension  or  axis  and  magnitude  and  phases  from  the  frequency  dimension. 
When  features  were  selected  from  the  time  and  frequency  dimensions,  the  geometrical 
relationship  between  these  dimensions  was  not  considered  to  form  a  two-dimensional 
space.  The  amplitudes  along  the  time  and  frequency  dimensions  were  not  taken  in 
pairs  but  singly,  hence  the  features  were  selected  from  a  larger  number  of  possible  one¬ 
dimensional  features. 

The  advantage  that  the  one-dimensional  features  have  over  2-dimensional  features 
is  the  lesser  computational  time  complexity  involved  with  1-dimensional  features.  For 
the  example  of  n  time  features  and  m  frequency  features  from  which  to  select,  the  time 
complexity  of  1-dimensional  features  is  0(n  +  m)  and  2-dimensional  features  is  0(n*m), 
where  O(-)  describes  the  order  of  the  magnitude  of  the  complexity  and  is  proportional 
to  the  term  in  parenthesis,  which  is  the  highest  order  parametric  term  of  the  computa¬ 
tion  time  equation.  This  results  in  a  very  large  differential  in  the  computational  time  if 
the  number  of  features  is  large  for  high  resolution  within  the  dimensions.  The  large 
computational  burden  of  many  type,s  of  feature  selection  processes  has  restricted 
research  of  the  2-dimensional  time-frequency  plane. 

Amplitudes  at  particular  times,  or  at  particular  latencies  of  the  evoked  potential, 
contain  energy  from  a  wide  range  of  frequencies  unless  the  signal  has  been  significantly 
filtered.  In  past  work,  the  filtering  usually  involved  low  pass  filtering,  which  allows  a 
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wide  band  of  frequencies  to  be  passed.  This  band  may  typically  be  0.1  Hz  to  25  Hz. 
Frequency  features,  either  magnitude  or  phase,  represent  energy  at  a  particular  fre¬ 
quency  from  the  expected  duration  of  the  signal  or  evoked  potential.  If  the  amplitude 
at  a  particular  time  was  measured  from  the  signal  after  being  filtered  to  allow  only  a 
narrow  band  of  frequencies  to  pass,  this  would  approximate  the  amplitude  of  a  region 
of  the  time-frequency  plane.  This  corresponds  with  frequency  features  which  represent 
energy  at  a  particular  frequency  from  a  particular  segment  of  the  signal  or  the  real  part 
of  a  frequency  component  at  a  particular  time  from  the  time-varying  spectrum.  Vari¬ 
ous  segments  of  the  signal  correspond  to  regions  along  the  time  axis  of  the  time- 
frequency  plane.  The  frequencies  of  the  signal  that  the  narrowband  filters  pass 
correspond  to  regions  along  the  frequency  axis. 

Continuing  research  will  investigate  the  features  representing  amplitudes  on  the 
time-frequency  plane  for  classification  and  detection  of  single  evoked  potentials.  A  2- 
step  feature  selection/classification  procedure  as  outlined  in  Figure  1  is  being  developed 
and  tested.  This  process  first  transforms  the  windowed  signals  into  frequency  com¬ 
ponents,  magnitude  and  phase,  then  selects  the  best  frequency  features  using  the  train¬ 
ing  set  signals.  The  set  of  frequencies  that  is  selected  contains  signal  energy'  or  infor¬ 
mation  useful  to  the  classifier  to  produce  low  error  rates.  Most  frequency  features  not 
selected  contain  energy  or  information  not  useful  in  the  classification  process,  and 
therefore  add  to  the  variance.  The  selected  frequencies  are  used  to  set  parameters  of  a 
set  of  filters  which  will  process  the  raw  data.  These  filters,  which  may  be  considered 
feature  transformation  functions,  will  be  designed  to  pass  those  frequencies  which  con¬ 
tain  the  majority  of  the  useful  information  for  classification,  while  rejecting  those  fre¬ 
quencies  which  contain  mainly  noise.  Noise  in  this  case  refers  to  that  part  of  the  meas¬ 
ured  signal  which  contains  no  information  useful  for  classification.  It  may  be  a  combi¬ 
nation  of  ongoing  EEG,  instrumentation  noise,  and  signal  energy  which  is  similar 
between  the  various  classes  to  be  separated. 
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The  amplitudes  of  the  outputs  of  these  filters  at  various  times  are  used  as  a  set  of 
features  from  which  the  classifier  and  feature  selector  routine  will  select  a  subset.  The 
first  step  is  classification  and  feature  selection  using  the  frequency  components  of  the 
entire  signal,  selecting  particular  frequency  lines  on  the  time-frequency  plane.  The 
second  step  is  filtering  the  signal  and  selecting  from  the  set  of  filtered  amplitude  values 
at  the  sampled  times  (latencies).  This  eliminates  searching  the  entire  time-frequency 
plane.  By  restricting  the  search  to  only  certain  frequencies,  the  second  step  selects 
times  at  the  selected  frequencies,  possibly  eliminating  some  of  the  selected  frequencies 
in  the  process.  The  results  will  be  selected  frequencies  and  times  where  the  set  of  th< 
amplitude  values  produce  high  classification  accuracies. 

The  on-line  type  classifier  structure  which  uses  features  previously  selected  is  sii 
lar  to  the  second  stage  of  the  process.  It  consists  of  a  bank  of  filters  at  the  frequencies 
selected  by  step  -1  and  maintained  by  step  -  2.  The  output  of  these  filters  are  used  by 
the  classifier  which  use  selected  latency  adjusted  amplitude  features  from  these  filtered 
signals  to  produce  the  desired  classification.  This  is  portrayed  in  Figure  2  where  the 
example  of  3  selected  frequencies  is  shown. 

Improved  EP  Waveform  Estimation 

Work  has  been  completed  on  development  of  the  theory  of  time-varying  filters  for 
improved  waveform  estimation.  This  work  is  described  in  detail  in  a  paper  to  be  pub¬ 
lished  in  the  November  1983  IEEE  Transactions  on  Biomedical  Engineering. 

The  time  varying  filter  is  designed  to  process  a  finite  duration  data  segment  and 
can  be  thought  of  as  an  operator  that  maps  the  vector  of  measured  values  into  a  signal 
vector.  The  processor  takes  the  following  form 

s(k)  =  £  hk(i)  x  x(i)  =  hjx  k  =  1,2,...,N 
i  =  l 

where  s(k)  is  the  estimate  of  the  kth  sample  point  of  the  signal,  hk(i)  is  the  ith  sample 


of  the  filter  function  for  estimating  the  kth  signal  value  and  x(i)  is  the  ith  sample  of  the 
data  set.  Collecting  the  N  estimators  together  leads  to  a  matrix  representation  of  the 
form 

s  =  H  x 

the  optimum  H  is  found  as  the  solution  to  the  matrix  equation 

H  =  K,,  K,-,' 

where  Fv.x  is  the  crosscovariance  matrix  of  the  signal  and  the  data  and  K*,,  is  the  auto¬ 
covariance  matrix  of  the  data. 

Performance  of  this  filter  has  been  evaluated  using  simulations  in  whic  h  signals 
similar  to  typical  average  EP  waveforms  were  combined  with  noise  having  the  same 
spectral  characteristics  and  amplitudes  as  the  ongoing  EEC. 

The  signal  selected  for  the  initial  simulation  study  was  a  non-random  signal 
corresponding  to  the  conventional  average  of  the  observations  of  the  evoked  potential 
in  electrode  Pz  elicited  by  200  visual  stimulations  with  a  checkerboard  pattern  in  the 
upper  half  visual  field.  The  noise  process  is  typically  measured  samples  of  the  on-going 
EEG  at  the  same  electrode  when  no  stimulation  is  present.  The  mean  of  the  on-going 
EEG  is  first  removed  and  then  the  noise  process  is  scaled  to  obtain  the  desired  signal- 
to-noise  ratio.  Two  hundred  simulations  were  carried  out  and  two  sets  of  results  typi¬ 
cal  of  those  obtained  are  shown  here. 

Fig.  3  is  the  first  set.  In  Fig.  3(a)  is  shown  the  sample  observation  which  is  the 
sum  of  the  signal  and  noise.  Fig.  3(b)  is  the  signal  estimate  obtained  by  using  the 
time-invariant  filter.  Fig.  3(c)  is  the  signal  estimate  obtained  by  using  the  time- varying 
filter.  The  original  signal,  is  also  included  in  each  plot  for  comparison.  Fig.  4  is 
another  set  of  the  simulation  results.  In  both  cases  a  signal- to- noise  ratio  of  -10  dB  is 
used  which  is  typical  of  SNR’s  occurring  in  evoked  potential  research.  The  time- 
varying  filter  is  seen  to  perform  much  better  than  the  time  invariant  filter.  Most  of  the 
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noise  is  filtered  out  by  the  time  varying  filter. 

The  same  set  of  data  was  used  to  evaluate  the  mean  square  error  performance  of 
the  filters  as  a  function  of  signal- to- noise  ratio.  The  noise  samples  are  scaled  so  as  to 
provide  the  specified  signal-to-noise  ratio.  For  a  signal-to-noise  ratio  typical  of  those 
occurring  in  evoked  potential  research  (-10  dB),  the  mean  square  error  was  found  to  be 
0.89  for  time-invariant  filter  and  0.36  for  time-varying  filter. 

The  time  varying  filter  adjusts  to  the  transient  nature  of  the  signal  and  nonsta- 
tionarity  of  the  noise  and  provides  a  more  powerful  filtering  operation  than  does  the 
time-invariant  filter.  The  time-invariant  filter  is  only  effective  for  stationary  processes 
and  thus  cannot  be  expected  to  be  optimum  for  ERP  waveforms  originating  from  an 
inherently  nonstationary  process. 

In  order  to  demonstrate  the  performance  of  the  filters  in  a  realistic  manner  yet 
retain  enough  control  of  the  test  parameters  to  permit  verification  of  the  performance, 
signals  were  modified  to  simulate  more  realistic  conditions.  The  noise  was  generated 
from  random  samples  having  a  covariance  matrix  identical  to  that  of  experimentally 
measured  samples  of  a  human  on-going  EEG  measured  at  scalp  electrode  position  Pz. 
The  basic  signal  was  the  same  average  evoked  potential  described  previously.  The  sig¬ 
nal  was  added  to  samples  of  the  noise  to  give  a  signal-to-noise  ratio  of  -6  dB.  Jitter 
was  produced  by  introducing  random  time  delays  in  the  signal  employing  a  Gaussian 
distribution  with  zero  mean  and  standard  deviation  8  ms.  This  choice  is  justified  by 
previous  studies  on  typical  evoked  potential  waveforms. 

Two  filters  were  designed  to  process  the  data  records.  One  filter  ignored  the  effects 
of  signal  time  jitter  and  is  called  a  constant  latency  filter  while  the  other  filter  took  this 
effect  into  account  and  is  called  a  variable  latency  filter.  In  order  to  illustrate  the  noise 
cancelling  performance  of  the  filters,  noise  waveforms  without  the  signal  were  processed 
as  well  as  the  signal  plus  noise  waveforms.  A  sampling  interval  of  4  ms  was  employed. 
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Fig.  5  shows  results  for  signal  latencies  of  0,  +12  and  -12  ms.  In  this  figure  the 
left  hand  waveforms  show  the  unfiltered  signal  plus  noise  (solid)  and  the  underlying  sig¬ 
nal  component  (dashed).  The  center  waveforms  are  the  outputs  of  the  constant  latency 
filter  (solid)  and  the  true  signal  waveform  (dashed).  The  right  hand  waveforms  are  the 
outputs  for  the  variable  latency  filter  (solid)  and  the  true  signal  (dashed).  It  is  evident 
from  these  waveforms  that  the  filtering  action  of  both  filters  is  very  strong  and  elim¬ 
inates  virtually  all  components  not  related  to  the  signal  waveform.  The  constant 
latency  filter  has  the  least  error  when  no  signal  displacement  is  present.  However, 
when  signal  displacement  is  present  a  better  result  is  obtained  with  the  variable  latency 
filter.  In  particular,  the  locations  of  the  peaks  can  be  accurately  recovered  when  the 
filter  that  incorporates  the  jitter  effect  is  employed. 

Fig.  6  shows  the  results  of  filtering  the  noise  waveforms  of  Fig.  5,  with  no  signal 
component  present.  In  this  figure  the  left  hand  waveforms  are  the  noise  waveform 
(dashed)  and  the  filtered  output  (solid)  for  the  constant  latency  filter  and  the  right 
hand  waveforms  are  for  the  variable  latency  filter.  It  is  evident  that  strong  noise 
suppression  occurs  when  only  noise  is  present. 

A  more  elaborate  simulation  which  makes  use  of  basis  functions  was  carried  out  to 
illustrate  the  effectiveness  of  the  time  varying  filter  with  more  variable  signals.  The 
signal  is  composed  of  several  signal  components,  each  of  which  is  allowed  to  move  ran¬ 
domly  and  independently  according  to  a  Gaussian  probability  distribution.  The  desired 
signal  components  are  typical  of  those  found  in  evoked  potential  waveforms  and  are 
represented  here  by  raised  cosine  wavelets.  The  polarities,  latencies,  amplitudes  and 
the  standard  deviations  of  the  latency  jitter  were  obtained  using  the  latency  corrected 
averaging  procedure  and  were  used  to  estimate  the  covariance  matrices  required  to 
design  the  filter.  The  basic  components  are  illustrated  in  Fig.  7  in  locations 
corresponding  to  zero  latency  jitter.  Each  component  consists  of  a  single  loop  of  a 
cosine  pulse  having  a  duration  of  40  ms. 
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The  noise  was  generated  from  random  samples  having  a  covariance  matrix  identi¬ 
cal  to  that  of  experimentally  measured  EEG  samples.  The  signal  was  randomly  gen¬ 
erated  and  consisted  of  the  seven  components  described  above.  These  randomly  jitter¬ 
ing  components  are  added  to  the  samples  of  the  noise  to  provide  a  sample  function  of 
signal  plus  noise.  The  resulting  data  were  then  processed  by  the  optimal  time  varying 
filter.  Samples  of  the  randomly  generated  signal  were  also  processed  by  the  filter  to 
investigate  the  distortion  performance  when  signal  alone  is  present.  In  order  to  illus¬ 
trate  the  noise  cancelling  performance  of  the  filters,  noise  waveforms  without  the  signal 
were  also  processed. 

Fig.  8  shows  samples  of  simulated  signal  plus  noise  and  the  corresponding  filtered 
outputs.  In  this  figure,  the  left  hand  waveforms  show  the  simulated  signal  plus  noise. 
The  right  hand  waveforms  are  the  outputs  of  the  filter  (solid)  and  the  true  underlying 
randomly  generated  signal  (dashed).  It  is  evident  from  these  waveforms  that  the  filter 
is  very  effective  in  eliminating  virtually  ail  components  which  are  not  related  to  any  of 
the  underlying  components. 

Fig.  9  shows  the  results  of  filtering  the  signal  only  and  noise  only  corresponding  to 
the  waveforms  of  Fig.  8.  In  these  figures  the  left  hand  waveforms  are  the  signal 
waveform  (dashed)  and  the  filtered  output  (solid)  and  the  right  hand  waveforms  are  the 
noise  waveforms  (dashed)  and  the  filtered  output  (solid).  It  is  evident  that  the  signal 
passes  through  the  filter  with  little  distortion  while  the  noise  is  substantially  filtered  out 
when  processed  by  the  filter. 

Measurement  of  Detailed  Structure  of  EP  Waveforms 

Improved  Instrumentation.  As  part  of  the  research  program  aimed  at  investigating 
the  fine  structure  of  EP  waveforms  it  was  found  necessary  to  substantially  modify  the 
method  of  controlling  the  simulus  presentation  so  that  uncertainties  in  the  timing  pro¬ 
duced  by  the  CRT  could  be  eliminated  from  the  experimental  procedure. 
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In  a  raster  scan  display  system,  the  image  presented  on  the  video  monitor  is  swept 
out  by  a  beam  which  begins  in  the  upper  left  hand  corner  of  the  display  and  traces 
across  the  screen  to  the  right  and  slightly  down.  This  is  repeated  262  times  to  trace 
out  the  entire  field.  Approximately  17  ms  are  required  to  trace  out  one  field  of  an 
image.  In  most  display  systems  the  raster  scan  is  synchronized  to  some  periodic  source 
and  when  a  trigger  is  sent  to  initiate  a  simulus  presentation,  unless  the  trigger  is  syn¬ 
chronized  to  the  same  source,  there  will  be  a  random  time  variation  between  the  time 
of  the  trigger  and  the  time  of  the  stimulus  presentation.  The  uncertainty  is  greatest 
when  stimulus  occupies  only  a  small  fraction  of  the  raster.  Accurate  synchronization  of 
the  EEG  data  sampling  with  the  stimulus  presentation  will  insure  that  the  beginning  of 
the  tracing  of  the  stimulus  image  on  the  video  monitor  occurs  at  the  same  sampling 
instant  in  each  record.  If  data  sampling  is  initiated  at  the  time  of  stimulus  presenta¬ 
tion,  then  the  vertical  retrace  pulse  can  be  used  as  a  fiducial  point  for  synchronization 
with  the  data  sampling.  The  stimulus  image  may  cover  only  a  portion  of  the  field,  in 
which  case,  following  a  vertical  retrace,  there  is  a  time  delay  before  the  vertical  scan 
begins  tracing  the  top  of  the  stimulus  image.  An  appropriate  time  delay  can  be  added 
after  the  vertical  retrace  before  initiation  of  sampling  so  that  the  first  sample  value 
corresponds  to  the  exact  time  of  the  beginning  of  image  presentation. 

It  is  often  desirable  to  randomize  the  interstimulus  interval  and  to  initiate  record¬ 
ing  of  data  prior  to  stimulation.  In  this  case  the  vertical  retrace  pulse  cannot  be 
directly  used  to  initiate  sampling.  This  is  because  there  may  not  be  an  integer  number 
of  fields  between  the  initial  vertical  retrace  and  the  time  of  stimulus  presentation. 
Without  synchronization,  the  time  at  which  the  vertical  scan  begins  tracing  the  top  of 
the  stimulus  image  is  a  random  variable  with  respect  to  the  sampling  instants  across 
the  repetitions.  This  random  variable  is  uniformly  distributed  over  a  17  ms  interval.  It 
is  possible  that  this  random  variable  contributes  to  the  latency  jitter  found  in  the  indi¬ 
vidual  components  of  the  event  related  potential  (ERP).  The  system  described  here 
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was  developed  to  correct  this  problem  by  finding  a  method  to  synchronize  the  presenta¬ 
tion  of  a  visual  stimulus  with  the  data  sampling.  Synchronization  is  a  desirable  pro¬ 
perty  of  the  stimulus  for  sharp,  well-defined  peaks  to  be  found  by  averaging.  Addi¬ 
tional  latency  jitter  due  to  stimulus  presentation  time  jitter  would  make  the  average  an 
even  more  unreliable  estimate  of  the  underlying  signal. 

By  aligning  a  photodetector  with  the  top  of  a  block  of  light  presented  in  the  mid¬ 
dle  of  the  monitor  and  sampling  its  output  as  though  running  an  experiment,  it  can  be 
determined  whether  the  stimulus  is  being  presented  at  the  same  instant  in  each  interval 
as  portrayed  in  Figure  10.  It  was  found  that  the  photodetector  output  showed  the 
appearance  of  the  light  source  at  random  time  samples  which  were  uniformly  distri¬ 
buted  over  a  17  ms  interval.  This  result  verified  that  the  stimulus  was  not  time-locked. 

The  first  attempt  to  synchronize  the  presentation  of  the  stimulus  was  hardware 
intensive.  The  tests  were  performed  using  visual  stimuli  generated  by  an  IBM-PC  com¬ 
puter  and  presented  in  the  system  monitor.  The  CRT  controller  for  the  IBM  display  is 
a  Motorola  6845.  According  to  Motorola  documentation  for  this  chip,  the  user  should 
be  able  to  reset  all  the  counter  registers  by  applying  a  negative  pulse  to  the  RESET 
input  on  the  chip.  The  advantage  of  using  this  method  is  that  the  raster  scan  can  be 
reset  to  the  top  of  the  screen  at  any  time  and  thus  synchronized  with  the  data  sam¬ 
pling.  This  method  requires  some  modification  of  the  video  display  board  to  generate 
the  appropriate  reset  signal  with  a  software  command.  Unfortunately  this  attempt  did 
not  solve  the  problem.  The  Motorola  documentation  was  apparently  inaccurate  in  this 
instance  and  it  was  not  possible  to  reset  the  CRT  controller  in  this  manner  to  syn¬ 
chronize  the  stimulus  and  data  sampling. 

A  different  approach  was  tried  using  both  hardware  and  software.  One  input  to 
the  IBM  control  program  is  the  prestimulus  sampling  interval  (PSI),  which  is  the 
amount  of  time  during  which  the  ongoing  EEG  is  sampled  before  stimulation.  Using 
this  parameter,  a  delay  time  between  a  vertical  sync  pulse  and  the  initiation  of  data 


IntvrstiMulus  Prvstiaulus  Postst i«ulus 


Figure  11.  Timing  Diagram  for  Sternberg  Paradigm  Experiment. 
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sampling  can  be  computed.  In  addition,  this  delay  time  can  be  adjusted  to  account  for 
the  time  required  for  the  video  scan  to  travel  from  the  top  of  the  monitor  (which  begins 
immediately  following  a  vertical  retrace)  to  the  top  of  the  stimulus  figure.  This  addi¬ 
tional  time  interval  is  referred  to  as  the  stimulus  delay  time  (SDT). 


Calculation  of  the  total  time  delay  is  as  follows: 

WT  =  VT  -  [PSI  mod  (VT)1  +  VT  +  SDT 


=  VT 


PSI  mod  (VT) 
VT 


+  SDT  , 


where  WT 
VT 
PSI 
SDT 


wait  time  after  receiving  vertical  sync  pulse, 
vertical  field  scan  time  =  16.6879  ms, 
prestimulus  sampling  interval  (ms), 
stimulus  delay  time  (ms). 


The  calculation  of  the  stimulus  delay  time  (SDT)  is: 

measure  x  =  distance  from  top  of  display  to  top  of  image  (inches). 
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total  screen  height  (inches), 

#  of  visible  scan  lines, 

#  of  total  scan  lines, 
vertical  field  scan  time. 
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During  the  experiment  when  sampling  is  to  be  initiated,  the  program  first  waits  for 
the  appearance  of  a  vertical  sync  pulse  from  the  video  controller.  When  this  pulse  is 
detected,  the  program  waits  the  precomputed  delay  time  (WT)  and  then  initiates  data 
sampling.  The  timing  diagram  for  one  trial  of  the  experiment  is  shown  in  Figure  11. 

It  is  necessary  to  detect  the  vertical  sync  pulse  in  order  to  begin  the  delay  time. 
This  was  done  by  wiring  the  vertical  sync  pulse  from  the  video  board  to  one  bit  of  the 
parallel  I/O  port.  This  bit  is  read  constantly  and  its  transition  signals  the  appearance 
of  a  vertical  sync  pulse  and  the  time  delay  (WT)  is  initiated. 

The  effectiveness  of  the  synchronization  procedure  became  immediately  apparent 
in  the  conventional  average  EP  computed  from  data  measured  with  the  modified  sys¬ 
tems.  Figure  12  shows  the  average  of  100  EP’s  resulting  from  application  of  visual 
stimuli  that  were  small  numbers  centered  on  the  face  of  the  CRT.  Because  of  the  pre¬ 
cise  synchronization  of  the  sampling  to  the  stimulus  presentation  the  electric  fields  radi¬ 
ated  by  the  deflection  circuit  of  the  display  are  also  synchronized.  Because  of  this  syn¬ 
chronization  the  electrical  fields  picked  up  by  the  wires  from  the  scalp  electrodes  add 
coherently  from  one  presentation  to  the  next  producing  the  noisy  waveform  shown  in 
Figure  12.  The  problem  was  completely  eliminated  by  moving  the  display  monitor  out¬ 
side  of  the  shielded  test  chamber  and  having  the  subject  view  the  monitor  through  a 
glass  window. 

One  of  the  purposes  of  increasing  the  precision  of  the  timing  measurement  was  to 
determine  whether  the  randomness  in  the  normal  procedure  was  producing  an  increase 
in  the  random  latency  variations  of  the  components  in  the  individual  EP’s.  Figures  13 
and  14  show  the  histograms  of  component  latencies  for  EP’s  obtained  during  the  Stern¬ 
berg  paradigm  experiment  that  is  described  in  detail  later  in  this  report.  Data  for  Fig¬ 
ure  13  were  measured  before  modification  of  the  timing  system,  and  data  corresponding 
to  Figure  14  were  measured  after  the  modification.  It  is  evident  from  the  figures  that  a 
better  clustering  of  the  latencies  of  peaks  around  this  means  occurs  for  the  data 
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measured  with  the  improved  synchronization.  This  is  most  noticeable  in  components 
having  latencies  less  than  300  ms.  A  precise  determination  of  the  reduction  in  jitter  is 
very  difficult  to  make  because  of  the  overlapping  of  the  distributions.  However,  visual 
study  of  the  histograms  indicates  that  the  reduction  in  the  standard  deviations  is  on 
the  order  of  2-3  ms.  This  leaves  inherent  random  latency  variations  with  standard 
deviations  in  the  range  of  7  ms  or  more  still  present  in  the  individual  EP’s. 

Experimental  Measurements.  The  Sternberg  paradigm  was  selected  for  generating 
experimental  EP  waveforms  to  be  used  in  this  research.  The  subjects  in  the  experi¬ 
ments  were  instructed  to  respond  to  the  visual  presentation  on  a  CRT  of  a  single  digit 
in  one  of  2  ways.  A  target  button  was  to  be  pushed  if  the  digit  presented  was  in  a  pre¬ 
viously  memorized  target  set  of  digits.  A  different  button  was  to  be  pressed  in  response 
to  a  digit  which  was  not  contained  in  the  target  set.  The  digits  presented  were  1 
through  9.  The  number  of  digits  in  the  target  set  was  varied  in  different  portions  the 
experiment,  being  either  I,  3,  or  5  target  digits.  Target  set  elements  remain  the  same 
during  the  experiment.  The  sequence  of  presentations  of  target  and  non-target  digits 
and  the  actual  digit  presented  from  the  set  were  determined  by  the  use  of  a  random 
number  generator  internal  to  an  IBM  PC  computer,  which  was  used  to  generate  and 
present  the  stimuli,  control  timing,  and  initiate  data  sampling.  Digits  from  the  target 
set  occurred  approximately  50%  of  the  time. 

Stimulation  occurred  in  sessions  of  60  at  a  time  with  a  2  to  5  minute  rest  period 
for  the  subject  in  between  sessions.  Twelve  sessions  of  data  taking  were  carried  out. 
The  order  of  the  number  of  digits  in  the  target  set  was  1,  3,  5,  repeated  4  times.  This 
provided  in  most  cases  sets  of  100  usable  data  records  for  each  number  of  target  digits 
in  the  target  and  non-target  response  classes.  Before  each  of  the  6rst  3  sessions,  prac¬ 
tice  runs  of  30  trials  were  given.  Before  each  session,  the  target  digits  were  reviewed 
with  the  subjects.  The  target  and  non-target  response  buttons  were  reversed  midway 
through  the  experiment.  A  practice  session  of  30  responses  was  given  before  the  session 
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following  button  reversal  to  accustom  the  subjects  to  the  change.  The  button  initially 
assigned  as  the  target  button  was  alternated  across  the  subjects. 

In  some  of  the  subjects  tested,  additional  sets  of  sessions  where  added  where  the 
subject  was  instructed  to  respond  only  mentally,  no  button  was  to  be  pressed.  A  set  of 
3  sessions  was  added  after  the  sixth  session  and  another  set  of  3  sessions  was  added  at 
the  end  of  the  normal  sessions.  These  data  were  processed  separately  and  will  be 
analyzed  at  a  later  date. 

Subjects  in  these  experiments  were  college  students  or  staff  ranging  in  age  from  23 
to  31.  They  were  comfortably  seated  in  an  IAC  environmental  chamber  which  has 
good  sound  isolating  and  electrical  interference  reducing  qualities.  The  video  monitor 
was  placed  outside  the  testing  chamber  to  reduce  AC  interference,  facing  in  through 
the  chamber  window  at  the  subject’s  eye  level,  1  meter  from  the  eyes.  A  masking  dev¬ 
ice  on  the  window  isolated  external  light  from  the  chamber  and  allowed  only  a  portion 
of  the  monitor  to  be  viewed.  The  chamber  was  dimly  lit  by  small  incandescent  light 
bulbs  operating  on  DC  power  to  prevent  AC  interference  internal  to  the  chamber. 

The  subjects  were  instructed  to  respond  as  quickly  and  consistently  as  possible 
without  making  a  multitude  of  mistakes.  They  were  instructed  that  1  or  2  mistakes 
per  session  of  60  were  tolerable.  The  index  and  middle  finger  of  the  right  hand  were 
used  to  respond.  All  subjects  were  right  handed.  The  switches  were  low-force,  positive 
action  pushbuttons.  An  LED  was  dimly  lit  over  the  target  button  in  case  the  subject 
needed  a  reminder  during  the  session.  The  subjects  were  instructed  to  avoid  eyeblinks 
and  body  movements  between  the  time  the  warning  box  disappeared  and  the  time  they 
responded. 

Data  were  recorded  beginning  1  second  prior  to  each  stimulation  and  for  1  second 
after  the  onset  of  stimulation.  The  digit  remained  on  for  1  second  during  which  time 
the  subject  was  to  respond.  Responses  after  this  time  were  considered  no-responses. 
The  warning  box  was  present  for  1/2  second  approximately  2  seconds  before  the  onset 
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of  stimulation.  The  time  of  presentation  actually  varied  uniformly  from  1.95  to  2.05 
seconds  to  prevent  alpha  wave  phase  locking  apparent  in  the  averages  of  the  responses 
as  noted  in  pilot  experiments.  An  interstimulus  interval  varying  uniformly  between  1 
and  3  seconds  occurred  between  the  turning  off  of  the  stimulus  and  the  onset  of  the 
warning  box. 

The  warning  box  was  a  0.5  cm  square  outline  of  a  box  centered  on  the  monitor. 
The  digits  filled  a  rectangle  1.5  cm  wide  x  2.5  cm  high  centered  on  the  monitor.  The 
brightness  was  set  fairly  low  to  avoid  noticeable  persistence  after  the  turning  off  of  the 
figures  and  to  reduce  subject  eye  fatigue. 

Beckman  Ag-Ag  Cl  electrodes  were  applied  to  the  scalp  with  double-sided  adhesive 
collars  and  electrolyte  cream  at  sites  Oz,  Pz,  Cz,  Fz,  P3,  and  P4  according  to  the  10-20 
system.  Reference  was  electrically  linked  ears.  The  electro-oculogram  (EOG)  was 
recorded  diagonally  across  the  left  eye  socket  for  detection  of  eyeblink  and  eye  move¬ 
ment  artifacts.  A  forehead  groun d  electrode  was  attached.  Electrode  impedances  wore 
lOKfl  or  below;  in  most  cases  these  were  below  5Kfl.  Electrode  impedances  were  tested 
after  every  2  to  4  sessions  and  electrodes  replaced  if  impedances  had  significantly 
increased. 

The  signals  and  response  switchbox  output  were  amplified  by  Grass  7P511 
amplifiers  with  bandwidth  set  to  0.1  Hz  to  100  Hz  (3db  bandwidth  cutoff  points).  Data 
were  monitored  at  the  outputs  of  the  amplifiers  by  a  chart  recorder  and  LED  meters 
which  indicated  signal  strength  in  3db  steps  with  the  highest  level  corresponding  to  the 
±1.0V  range  of  the  analog  to  digital  (A/D)  converter.  Amplifier  gain  levels  were 
adjusted  to  use  the  entire  dynamic  range  of  the  A/D  converter  without  saturation. 
The  system  was  calibrated  prior  to  the  start  of  data  recording. 

The  analog  data  were  digitized  by  the  LPS-11  laboratory  peripheral  system  under 
control  of  a  DEC  PDP  11/45  computer  with  a  UNDC  operating  system.  The  data  were 
sampled  at  250  samples  per  second  and  quantized  to  12  bits.  The  raw  data  were 


recorded  on  magnetic  tape.  Sampling  was  initiated  by  the  IBM  computer  and  was  syn¬ 
chronized  to  the  exact  time  of  stimulus  presentation  (which  occurred  1  second  after 
sampling  began).  This  synchronization  process  is  discussed  separately. 

The  data  were  then  processed  to  detect  eyeblink  artifacts  and  A/D  converter 
saturation.  Any  eyeblink  detected  or  saturation  occurring  in  any  electrode  data 
between  500  ms  prior  to  and  400  ms  after  stimulation  were  rejected  from  subsequent 
processing.  Eyeblink  detection  occurred  when  there  was  at  least  a  50  fiX  change  in  100 
ms.  Saturation  occurred  when  2  consecutive  A/D  limit  values  were  detected.  The  first 
3  records  from  each  session  were  automatically  rejected.  The  data  were  separated  into 
files  of  V  or  ‘t’  for  non-target  or  target  digits,  and  1,  3,  or  5  for  the  number  of  digits  in 
the  target  set.  The  files  were  then  processed  to  separate  the  incorrect  from  the  correct 
responses  as  determined  by  the  response  switchbox  data.  Statistics  of  the  response 
times  were  computed. 

Data  files  with  correct  responses  only  were  averaged  across  the  ensemble  of 
responses  for  each  class  of  data.  Also,  the  variances  of  the  averages  were  computed. 
Three  sets  of  plots  were  produced  for  each  electrode: 

1)  Average,  average  +1  SD,  average  -1  SD  for  each  of  the  classes.  Entire  2 
seconds  of  data  were  plotted. 

2)  Averages  for  1,  3,  and  5  digits  in  the  target  set  were  plotted  on  the  same 
graph  for  the  target  and  non-target  classes.  600  ms  of  data  were  plotted 
starting  at  stimulation. 

3)  Averages  for  target  and  non-target  were  plotted  on  the  same  graph  for  each  of 
the  various  numbers  of  digits  in  the  target  set.  600  ms  of  data  were  plotted 
starting  at  stimulation. 

Data  files  were  produced  which  contained  the  segments  of  data  from  0  to  600  ms. 
These  data  files  for  electrode  Pz  were  then  processed  by  the  latency-corrected  average 
(LCA)  program.  The  statistics  of  the  detected  peaks  were  printed  out.  The  histogram 
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of  the  detected  peaks  across  the  records  along  with  the  average  were  plotted.  Peak 
detection  was  performed  after  the  data  was  filtered  by  a  MMSE  filter  and  low-passed 
filtered  to  25  Hz  to  smooth  the  data.  The  continuous  latency-corrected  average  was 
computed  for  electrode  Pz  using  the  results  of  the  LCA.  These  were  plotted  along  with 
their  corresponding  averages. 

A  preliminary  analysis  of  the  Sternberg  paradigm  data  has  been  carried  out  along 
the  following  lines. 

1)  The  single  ERP  during  a  task  relevant/irrelevant  type  of  paradigm  is  com¬ 
posed  of  a  series  of  peaks  which  may  or  not  be  related  to  the  decision  making 
process.  The  relationship  that  these  peaks  have  to  the  decision  making  pro¬ 
cess  was  investigated  in  a  Sternberg  type  paradigm  designed  to  elicit  a  variety 
of  responses  under  different  experimental  conditions. 

2)  It  has  been  theorized  that  the  P300  wave  characteristic  of  this  type  of  experi¬ 
ment  is  composed  of  a  number  of  separate  peaks  which  are  “smeared  out” 
during  the  conventional  ensemble  averaging  process.  Procedures  such  as  the 
Latency  Corrected  Average  (LCA)  and  the  Continuous  Latency  Corrected 
Average  (CLCA)  were  utilized  with  the  data  obtained  from  the  experiments 
carried  out  in  our  laboratory.  These  techniques  identify  the  individual  com¬ 
ponents  of  a  response  permitting  their  correlation  with  other  experimental 
variables  to  be  determined. 

3)  Components  of  the  event  related  potential  other  than  P300  may  be  reliably 
correlated  with  the  cognitive  processing  of  data.  This  is  an  area  that  was 
investigated  using  the  results  of  the  LCA  and  the  CLCA  algorithms. 

The  results  of  the  preliminary  analysis  are  presented  in  two  parts.  First,  an 
analysis  is  made  of  the  average  event  related  potentials  obtained  using  the  Sternberg 
paradigm  described  earlier.  General  characteristics  of  each  of  the  responses  is  detailed 
and  compared  to  the  responses  obtained  from  all  of  the  electrodes  used.  Second,  an 


analysis  is  made  of  the  LCA  and  CLCA  results  obtained  for  the  experimental  condi¬ 
tions. 

Data  for  four  subjects  are  shown  in  Figures  15-22.  Figures  15,  17,  19,  21 
correspond  to  averages  for  subjects  1,  2,  3,  and  4  from  four  electrodes  for  responses 
when  the  stimulus  contained  a  member  of  the  target  set.  Figures  16,  18,  20  and  22  are 
averages  from  the  same  subjects  for  responses  when  the  stimulus  was  not  a  member  of 
the  target  set. 

Subject  #1  -  (see  Figures  15  and  16).  The  P300  wave  occurred  earlier  in  the  tar¬ 
get  set  than  in  the  non-target  set.  This  difference  was  of  the  order  of  50  ms.  In  the 
target  set,  P300  for  the  one  digit  target  set  occurred  at  360  ms  whereas  in  the  non¬ 
target  set,  it  occurred  at  410  ms.  The  separation  in  the  latency  of  P300  for  the 
different  responses  and  for  increasing  numbers  in  the  set  was  maintained  in  the  event 
related  potentials  for  the  non-target  set.  The  ERP’s  for  the  target  set  did  not  maintain 
this  separation  when  the  set  size  was  increased  from  1  to  3  to  5  numbers. 

The  P300  wave  in  both  of  the  target  and  non-target  ERP’s  is  an  easily  identifiable 
low-frequency  waveform.  In  the  ERP’s  of  the  non-target  set  it  is  consistently  preceded 
by  a  negative  waveform  at  a  latency  of  approximately  280  ms.  For  the  target  set,  how¬ 
ever,  this  negative  waveform  does  not  appear  for  the  set  size  of  one  digit,  and  it  is 
clearly  visible  for  increasing  numbers  in  the  set. 

The  latencies  of  P300  in  the  Cz  electrode  were  as  follows: 

ERP’s  for  the  Target  Set:  1  number  -  360  ms 

3  numbers  -  405  ms 
5  numbers  -  405  ms 
ERP’s  for  the  Non-target  Set:  1  number  -  410  ms 

3  numbers  -  450  ms 


5  numbers  -  475  ms 
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Subject  #2  -  (see  Figures  17  and  18)  -  As  with  Subject  #1,  the  P300  wave 
occurred  earlier  in  the  ERP's  for  the  target  responses  than  for  the  non-target  responses. 
The  difference  was  on  the  order  of  90  ms.  In  this  subject,  the  P300  type  activity  seems 
to  be  a  very  low  frequency  phenomenon  and  thus  it  becomes  difficult  to  distinguish 
whether  any  separation  occurs  for  the  P300  waveforms  of  the  different  set  sizes.  An 
indication  may  be  obtained  from  the  rising  slope  of  the  P300  wave,  especially  in  the 
non-target  ERP’s,  which  indicate  that  indeed  the  1,3  and  5  sets  are  separable  by  these 
ERP’s  (see  Figure  18).  Using  the  same  method,  however,  it  was  not  possible  to  demon¬ 
strate  conclusively  that  the  ERP’s  corresponding  to  the  target  set  could  be  used  to  dis¬ 
tinguish  between  the  different  sets. 

Subject  #3  -  (see  Figures  19  and  20)  -  The  latency  of  the  P300  waveform  for  the 
set  size  of  one  number  occurs  earlier  in  the  target  set  than  in  the  non-target  set.  This 
seems  to  be  a  consistent  result  with  this  subject  and  with  previous  subjects  in  the 
study.  As  with  the  preceding  subject,  the  P300  phenomenon  is  of  very  low  frequency 
and  difficult  to  identify  clearly.  It  seems  as  if  there  is  a  general  trend  to  longer  laten¬ 
cies  with  increasing  set  size,  but  this  is  only  a  subjective  assessment  of  the  data,  since  it 
is  impossible  to  visually  distinguish  the  different  peaks.  (See  Figure  19). 

Subject  #4  -  (see  Figures  21  and  22)  -  The  target  ERP’s  for  this  subject  show  the 
characteristic  earlier  occurrence  of  P300  when  compared  to  the  non-target  set. 
Although  it  is  difficult  to  interpret  the  data  because  of  the  occurrence  of  multiple  peaks 
in  the  P300  region,  it  seems  as  if  the  P300  waves  corresponding  to  the  higher  order 
numbers  in  the  set  occur  at  longer  latencies  (see  Figure  21).  The  non-target  ERP’s  are 
even  more  difficult  to  analyze  because  of  the  lack  of  definition  of  the  response  in  the 
P300  interval.  By  using  the  rising  slope  criterion  on  the  target  set  of  ERP’s  one  could 
conclude  that  the  P300  waves  have  increasingly  longer  latency  for  larger  numbers  in 
the  target  set  (see  Figure  22). 
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Figure  21.  Conventional  average  for  Sternberg  paradigm. 
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The  structure  of  the  ERP’s  was  further  analyzed  by  utilizing  the  results  from  the 
Continuous  Latency  Corrected  Average  (CLCA).  Figures  23-30  are  the  Continuous 
Latency  Corrected  Averages  (CLCA)  for  electrode  Pz  for  the  same  test  conditions  as 
Figures  15-22.  The  solid  line  is  the  CLCA  data  and  the  broken  line  is  the  conventional 
average.  Numerical  results  of  the  LCA  procedure  corresponding  to  these  figures  are 
given  in  the  Appendix. 

Subject  #1  -  (see  Figures  23  and  24)  -  The  results  of  the  CLCA  for  this  subject 
reveal  an  apparent  substructure  to  the  P300  waveform  not  shown  in  the  conventional 
average  response.  It  should  be  noted  that  if  two  consecutive  peaks  of  the  same  polarity 
are  found,  the  fitting  procedure  used  by  the  CLCA  interpolates  and  locates  a  peak  of 
opposite  polarity  between  them.  Because  of  this,  there  are  some  peaks  in  the  response 
that  are  artificial.  The  validity  of  any  peak  can  be  checked  by  the  LCA  tabular  data 
given  in  the  Appendix.  The  ERP’s  for  the  target  response  to  one  number  show  two 
positive  peaks:  one  located  at  347  ms  and  the  other  at  397  ms.  For  the  three  number 
set,  there  is  one  prominent  positive  peak,  located  at  393  ms.  For  the  five  number  set, 
there  is  one  prominent  peak  located  at  401  ms.  It  is  also  noticed  that  whereas  the 
peaks  for  the  one  and  three  number  set  are  sharply  defined,  the  one  for  the  five  number 
set  is  not.  This  kind  of  substructure  of  the  P300  region  is  not  readily  recognizable  from 
examination  of  the  conventionally  averaged  ERP’s  of  this  data. 

For  the  non-target  set,  a  similar  kind  of  substructure  is  demonstrated  for  the 
ERP’s  in  the  area  of  the  P300  response.  For  the  one  number  set,  a  series  of  three 
peaks  are  evident  at  latencies  of  370  ms,  418  ms,  and  451  ms.  There  is  also  a  peak  at 
370  ms  which  is  not  immediately  observed  in  the  ERP’s  to  the  target  set.  For  the 
three  number  set,  the  substructure  is  more  evident,  with  positive  paks  at  376  ms,  414 
ms,  and  464  ms.  For  the  five  number  set,  although  the  procedure  did  not  find  a  posi¬ 
tive  peak  in  the  370  ms  area,  the  interpolating  procedure  located  a  peak  there  following 
the  general  pattern  of  the  rest  of  the  components  of  the  response.  The  conclusion  was 
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reached  from  examination  of  the  averaged  data  that  the  non-target  set  showed  an 
increase  in  P300  latency  with  an  increase  in  the  number  of  digits  in  the  set.  It  is  more 
difficult  to  arrive  at  the  same  conclusion  from  careful  examination  of  the  CLCA  data. 
The  data  substructure  appears  to  be  composed  of  peaks  that  are  consistently  found  in 
the  CLCA  but  not  found  in  the  averaged  data  (see  the  peak  found  at  370  ms  in  the 
non-target  set). 

Subject  #2  -  (see  Figures  25  and  26)  -  Analysis  of  the  structure  of  the  CLCA  for 
the  non-target  set,  reveals  some  interesting  facts.  There  is  a  negative  peak  identified 
by  the  CLCA  for  the  non-target  set  for  the  three  and  five  number  set  respectively. 
This  peak  was  not  identified  for  the  one  number  set  perhaps  because  it  was  too  low  in 
the  noise.  Interestingly,  the  percent  of  the  time  that  this  peak  is  found  appears  to 
increase  with  an  increase  in  the  number  of  digits  in  the  set.  If  one  ..ssumes  that  in  the 
one  digit  case  the  peak  was  not  found,  in  the  three  number  set,  it  was  found  in  39%  of 
the  cases  and  in  the  five  number  case  in  56%  of  the  cases,  then  perhaps  this  peak  might 
be  associated  (for  the  non-target  case)  with  an  increase  in  the  number  of  digits  in  the 
set.  It  is  also  interesting  to  observe  that,  as  with  the  first  subject,  this  peak  is  not 
present  in  the  ERP’s  corresponding  to  the  target  number  being  present. 

The  ERP’s  corresponding  to  digits  in  the  target  set  have  an  increase  in  energy  in 
the  region  between  300  and  400  ms  which  is  not  present  in  the  non-target  set  ERP's. 
Using  the  previously  described  slope  criterion  for  the  activity  in  this  region,  one  could 
conclude  that  the  latency  of  the  beginning  of  the  activity  in  this  region  is  directly 
related  to  the  number  of  digits  in  the  target  set.  The  more  numbers  in  the  target  set, 
the  later  the  activity  begins  in  this  region.  It  still  becomes  difficult  to  associate  an  indi¬ 
vidual  peak  with  the  “P300”  wave. 

Subject  #3  -  (see  Figures  27  and  28)  -  Analysis  of  the  structure  of  the  CLCA  for 
the  non-target  set  reveals  again  the  appearance  of  a  negative  peak  occurring  between 
360  ms  and  390  ms.  This  peak  is  not  readily  identifiable  in  the  average  response.  The 
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positive  set  for  the  three  digits  response  also  shows  a  negative  peak  occurring  at 
approximately  397  ms.  However  this  peak  is  not  present  in  the  response  for  the  one 
digit  and  the  five  digit  ERP.  The  area  of  the  P300  response  shows  a  structure  which  is 
difficult  to  interpret  on  the  basis  of  the  data  for  this  one  subject.  It  appears  as  if  in  the 
target  ERP  for  the  one  digit  set,  the  structure  of  the  P300  response  consists  of  a  series 
of  positive  and  negative  peaks  in  the  area  between  300  and  400  ms.  This  same  pattern 
of  alternating  polarity  peaks  seems  to,  be  present  in  the  area  following  400  ms  in  the 
ERP’s  for  the  non-target  set  corresponding  to  one  digit. 

Subject  #4  -  (see  Figures  29  and  30)  -  The  negative  peak,  characteristic  of  the 
non-target  set  of  responses,  is  present  in  this  set  of  ERP’s.  It  is  also  present  in  the  tar¬ 
get  set  of  ERP’s  but  not  as  often.  This  suggests  that  this  peak  is  of  much  lower 
signal-to-noise  ratio  in  the  target  set  of  ERP’s  than  in  the  non-target  set  of  ERP’s. 
This  set  of  responses  is  also  difficult  to  analyze  because  of  the  complex  wave  structure 
around  the  P 300  interval. 

Figures  31  to  34  show  the  superimposed  CLCA  plots  for  the  target  and  non-target 
set  of  ERP’s  for  the  four  subjects  tested.  Comparing  these  figures  to  Figures  15 
through  22  where  the  conventional  averaged  ERP’s  were  superimposed,  it  is  observed 
that  the  P300  region  exhibits  a  fine  structure  which  is  not  readily  discernible  from  the 
averaged  ERP’s.  These  very  preliminary  results  indicated  that  the  P300  phenomenon 
is  not  composed  solely  of  a  low  frequency  wave,  but  that  a  much  finer  structure  and 
detail  are  the  predominant  characteristics  of  the  endogenous  response. 
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Figure  23.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 

average  (broken)  for  Subject  1,  target  set.  The  number  of  targets 
in  the  set  is  indicated  on  the  right. 


P 


LATENCY  (m«) 


Continuous  Latency  Corrected  Average  (solid)  and  conventional 
average  (broken)  for  Subject  1,  non-target  set.  The  number 
of  targets  in  the  set  is  indicated  on  the  right. 
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Figure  25.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 

average  (broken)  for  Subject  2,  target  set.  The  number  of  targets 
in  the  set  is  indicated  on  the  right. 
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Figure  26.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 
average  (broken)  for  Subject  2,  non-target  set.  The  number 
of  targets  in  the  set  is  indicated  on  the  right. 
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Figure  27.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 


average  (broken)  for  Subject  3,  target  set.  The  number  of  targets 
in  the  set  is  indicated  on  the  right. 
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Figure  28.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 
average  (broken)  for  Subject  3,  non-target  set.  The  number 
of  targets  in  the  set  is  indicated  on  the  right. 
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Figure  29.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 

average  (broken)  for  Subject  4,  target  set.  The  number  of  targets 
in  the  set  is  indicated  on  the  right. 
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Figure  30.  Continuous  Latency  Corrected  Average  (solid)  and  conventional 
average  (broken)  for  Subject  U,  non-target  set.  The  number 
of  targets  in  the  set  is  indicated  on  the  right. 
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Continuous  Latency  Corrected  Average  for  Sternberg  paradigm 
Subject  1 ,  target  and  non-target  across  the  three  set  sizes 


Figure  32.  Continuous  Latency  Corrected  Average  for  Sternberg  paradigm 
Subject  2,  target  and  non-target  across  the  three  set  sizes 
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Figure  33.  Continuous  Latency  Corrected  Average  for  Sternberg  paradigm, 
Subject  3,  target  and  non- target  across  the  three  set  sizes. 


Figure  34.  Continuous  Latency  Corrected  Average  for  Sternberg  paradigm, 
Subject  4,  target  and  non-target  across  the  three  set  sizes. 
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|{ eaction  Time  and  the  OLOA 

From  the  LCA  statistics,  two  peaks  were  chosen  as  P3a  and  P3b  for  each  subject 
and  for  each  set  of  targets.  The  mean  reaction  time  for  each  of  the  trials  for  each  sub¬ 
ject  was  computed  and  an  overall  mean  reaction  time  calculated.  In  order  to  account 
for  mean  differences  across  subjects,  the  average  component  latencies  and  reaction 
times  across  the  target  sets  were  computed.  The  resulting  mean  values  for  each  subject 
were  subtracted  from  that  subjects’  latencies  and  reaction  times.  Correlation 
coefficients  were  computed  using  12  ordered  pairs  for  P3a  and  RT  (reaction  time),  and 
11  ordered  pairs  for  P3b  and  RT.  The  estimate  used  was: 

.  _  EfXYl  -X  Y 
<rx  <7y 

where  each  order  pair  is  (X,Y).  The  estimates  of  the  standard  deviation  for  X  and  Y 

were  computed  from  the  values  of  the  data.  The  resulting  estimates  of  the  correlation 

coefficients  were  as  follows: 

(P3a,RT)  r  =  0.287  p  <  0.19 

(P3b,RT)  r  =  0.753  p  <  0.003 

These  results  indicate  a  high  degree  of  correlation  with  the  P3b  wave,  determined 
from  the  LCA  results,  with  the  reaction  time  following  presentation  of  the  stimulus. 


APPENDIX 


File  Specification  Key  for  Appendix 


Subject  1  .  sp4[a][b].pz 

Subject  2  .  sp5[a][b].pz 

Subject  3  .  sp7[a][bj.pz 

Subject  4  .  sp8[a][b].pz 

where  [a]  =  t  for  target, 

=  n  for  nontarget, 

and  [b]  =  the  number  of  digitis  in 

the  target  set  -1  or  3  or  5. 
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